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Introduction 

Let X be a random variable having probability distribution P(X/0), 0 e 0 . It is 
desired to test H 0 :0e® o against HpOeQj =©-® 0 . Let S denote the sample space of 

outcomes of an experiment and x = (x , , x 2 , ,x n ) denote an arbitrary element of S. A test 

procedure consists in diving the sample space into two regions W and S - W and deciding to 
reject Ho if the observed x e W . The region W is called the critical region. The function 
y(0) =P e ( x e W ) = P 0 (W) , say, is called the power function of the test. 

We consider first the case where 0 O consists of a single element, 0 O and its 
complement ©j also has a single element 0,. We want to test the simple hypothesis 
Ho : 0 =0 O against the simple alternative hypothesis Hi : 0 =0,. 



Let Lo = L(X/Ho) and Li = L(X/Hi) be the likelihood functions under Ho and Hi 
respectively. In the Neyman - Pearson set up the problem is to determine a critical region W 
such that 

Y(0o) = p e o (W) = |L 0 dx = a, an assigned value (1) 

w 

and y(0i) = p 0| (W) = jL,dx is maximum (2) 

W 

compared to all other critical regions satisfying (1). 

If such a critical region exists it is called the most powerful critical region of level a. 

By the Neyman-Pearson lemma the most powerful critical region Wo for testing H 0 :9 = 9 0 
against H 1 \9 = 9 1 is given by 

W 0 = {x :Lj>kL 0 } 

provided there exists a k such that (1) is satisfied. 

For this test y(0 o ) = a and y(0, ) — > 1 as n — » a . 

But for any good test we must have y(0 o ) — > 0 and y(0j ) -> 1 as n — » co because complete 

discrimination between the hypotheses Ho and Hi should be possible as the sample size 
becomes indefinitely large. 

Thus for a good test it is required that the two error probabilities a and (3 should 



depend on the sample size n and both should tend to zero as n — » go . 




We describe below test procedures which are optimum in the sense that they 
minimize the sum of the two error probabilities as compared to any other test. Note that 
minimizing ( a + P ) is equivalent to maximising 

1 -(a + P)=(l-P)-a= Power - Size. 

Thus an optimum test maximises the difference of power and size as compared to any other 
test. 

Definition 1 : A critical region Wo will be called optimum if 

jLjdx - |L 0 dx > jLjdx - jL 0 dx (3) 

w 0 w 0 w w 

for every other critical region W. 

Lemma 1: For testing Ho: O = 0 o against Hi : 0=0! the region 
W 0 = {x : Lj > L 0 } is optimum. 

Proof : Wo is such that inside Wo, Li^L 0 and outside Wo , L t <L 0 . Let W be any other 
critical region. 

f(L 1 -L 0 )dx-[(L 1 -L 0 )dx 

W 0 W 

= j (L[ -L 0 )dx - J(L 1 -L 0 )dx, 

w 0 nw c wnw 0 c 



by subtracting the integrals over the common region Wo fl W. 




since the integrand of first integral is positive and the integrand under second integral is 
negative. 

Hence (3) is satisfied and Wo is an optimum critical region. 

Example 1 : 

Consider a normal population N(0,cr ) where a 2 is known. 



It is desired to test H 0 : 0 = 0 O against Hi : 0 =0 t , 0j > 0 O . 



L( x/0)= 



r i r -§ 




(Xj -0) 2 

2a 2 



Kx.-ej 2 

L t _ e 2 a 2 

Lq X ( x i ~Qq ) 
e 2a 2 

The optimum test rejects H 0 




i.e. if log — ->0 



. ., 2>i- 0 i) 2 Z(xi-0 o )\ n 

i.e. if + — >0 



2a- 



2a- 



i.e. if 20j^Xi -n©^ -2po^ x i + n 0o - 0 

i-e-if (20 1 -20 o )Xx i >n( 0 1 2 - 05 ) 




i.e. if 



> 01+9 



n 



i.e. if x > 



01+0 O 



Thus the optimum test rejects H 0 



0i+0O 

if x>-^ y- 



We have 



a = Pi 



H„ 



x> 6|+9 ° 



= P 



H, 



x ~9p > V n (Qi ~Qq ) 

a/ Vn 2a 



x —0 

Under H 0 , 7 ^7 follows N(0,1) distribution. 




••• a = 1 - O 



Vn(0i -0 O ) 



2 a 



where O is the c.d.f. of a N(0,1) distribution. 



P = P 



H, 



i< 9 1 + 9 £ 



= P 



H, 



x - 0i 



< 



Under Hi, follows N(0,1) distribution. 




Vn(9i-9o) 

2a 




p = i-o 




Here a = P . 

It can be seen that a = P — > 0 as n — » go . 

Example 2 : For testing H 0 : 0 = 0 O against Hi : 0 =0, , 0j < 0 O , the optimum test rejects 

_ 01 + 0Q 

H 0 when x < . 

2 

Example 3 : Consider a normal distribution n(o, a 2 ), 0 known. 

2 2 2 2 2 2 

It is desired to test H 0 : ct = ag against HI : a" =af,af >ag. 

We have 








The optimum test rejects Ho 



L t 

if 1>1 

L o 



i.e. if Gl 9 ^ Z( x i ~ 6 ) 2 ^ ^ ( lQ g °~1 -logcyg) 



2afag 



i-e. if Z(Xl 2 ~ e)2 >4 a 4(log^-log^) 
CT 0 af-ao 



i.e. if Yj 



^Xj-e^ 2 
V a O j 



> nc 



where c = ^ 2 (log a? - logao ) 
a i “ a 0 



— — ) > nc. 

(J 0 J 



x • — 0 ' 

Note that under H 0 : — follows N(0,1) distribution. Hence V 



^ Xi -e ^ 2 

V a 0 J 



follows, under 



H 0 , a chi-square distribution with n degrees of freedom (d.f.). 



Here a = P 



H n 



z 



f *\ -9 0 V 
v a o j 



> nc 



= P 



l^(n) ~ nC 



and 1 - P = P 



H, 



z 



^ Xi -e ^ 2 

V a 0 J 



> nc 



Ph, 



I 



f ncajj 



Xj -0 
V a l J 



> 



<*1 




a l 



( X .-Q\ 2 

— — J follows a chi-square distribution with n d.f. 



It can be seen that a — > 0 and P —> 0 as n — >• go. 



Example 4 : Let X follow the exponential family distributions 



f(x/e) = c(e)e Q ^ T(x) h(x) 



It is desired to test H 0 : 0 = 0 O against Hi : 0 =0[ 



L(x/0) = [c(0)] n e 



|n p Q(0)ZT( Xi ) 



H h (Xi) 



The optimum test rejects H 0 when 



Li 

log—> 0 
L o 



i.e. when [Q(0i ) - Q(0 O )E T ( x i ) ^ n lo § 



c(0 O ) 



, c(0 o ) 

nlog — 

i.e. when VTfxdX T if Q(0i ) -Q(0n) > 0 

^ [Q(0i)-Q(0 o )] 



and rejects H 0 



„lo g 5<M 

when It<x,) -[qwTwH ifQ(ei)_Q<e ° )<0 



Locally Optimum Tests: 




Let the random variable X have probability distribution P(x/9). We are interested in 



testing Ho: 0 = 0 O against Hi : 0 >0 q . If W is any critical region then the power of the test 
as a function of 9 is 

y (9) = P e (W ) = f w L(X/9)dx 

We want to determine a region W for which 

y(9) - y(9 0 ) = f w L(x/9)dx - j w L{x/9 ) 

is a maximum. 

When a uniformly optimum region does not exist, there is not a single region which is 
best for all alternatives. We may, however, find regions which are best for alternatives close 
to the null hypothesis and hope that such regions will also do well for distant alternatives. We 
shall call such regions locally optimum regions. 

Let y(0) admit Taylor expansion about the point 9 = 9 0 . Then 
y(0) = y(9 0 ) + (9 — 9 0 )y(9 0 ) + S where 8 -> 0 as 9 -> 9 0 
••• y(0) - y(0 o ) = (9 - 9 0 )y(9 0 ) + 8 

If \9 — 9 0 \ is small y(0) — y(0 o ) is maximised when y(0 o )is maximised. 

Definition2 : A region Wo will be called a locally optimum critical region if 

I Wg L(x/9 0 )dx > j w L(x/ 9 0 )dx (4) 

For every other critical region W. 

Lemma 2 : Let Wo be the region (x: L(x/0 o ) > L(x/0 o )}. Then Wo is locally optimum. 




Proof: Let Wo be the region such that inside it L(x/0 o ) > L(x/0 o ) and outside it 
L(x/0 o ) <L(x/0 o ). Let W be any other region. 

f Wo L(x/d 0 )dx - j w L(x/ 9 0 )dx 

fw onwC Ux/9 0 )dx - j wSnw L(x/e 0 )dx 

fw onwC Ux/Bo)dx + j wSuw L(x/do)dx (*) 

- bonwc L(x/0 ° )dx + fwgu w L(x/8o)dx 

since L(x/0 o ) > L(x/0 o ) inside both the regions of the integrals. 
>0, since L(x/0 o ) > 0 in all the regions. 

Hence / L(x/d 0 )dx > f w L(x/9 0 )dx for every other region W. 

To prove (*): 

We have f L(x/0 o )dx + f RC L(x/0 o )dx = 1 for every region R. 

Differentiating we have 

I L(x/0 o )dx + I L(x/0 o )dx = 0 
Jr Jr c 

I L(x/8 0 ')dx = — I L(x/8 o )dx = 0 
Jr Jr c 

In (*), take R c =Wg n W and the relation is proved. 



Similarly if the alternatives are Hi : 0 <0 q , the locally optimum critical region is 




[ x:L(x/e 0 ) < L(x/e 0 )}. 



Example 5: Consider N(9, a 2 ) distribution, a 2 known. 
It is desired to test Hq: 0 = 0 O against Hi : 0 >0 q 



/ i \ n -m-d ) 2 
L(x/0) = ( ;=) e 2(7 2 



VoVZnv 



logL(x/9 ) = n/og ( 






\ _ SO* 



0); 



2er 2 



L(x/9 ) 8logL(x/9 ) £(*( — 0) n(x — 0) 

L(x/0) 50 cr 2 cr 2 

U*/9 0 ) _ n(x - 0 O ) 

L(x/0 o ) o- 2 



The locally optimum test rejects Ho ,if 



w(* ~ £q) 

cr 2 — 

_ (T^ 

i.e. x > 0 O H 

n 



Now, 



a = Pu 



a 

x > 0 O H 

n 



P Hn 



\x - 9 0 
7f 



> 




(7 



since under H 0 , 



x-o o 






= 1-0 



follows N(0,1) distribution. 




1 -P = P H . 



\x 



>Oo + 7 , 



n 



Ph, 



x — 9i 9i — 0 n a 



= 1 - 0 ) 



-(01 - 0 o Vtt) £7 

o yfn 



x—Q 

since under Hi, - — - follows N(0,1) distribution. 

A/n 



Exercise : If 0 O = 10, 0i = 11, cr = 2, n = 16, then a = 0.3085, 1-/? = 0.9337 
Power - Size = 0.6252 

If we reject H 0 when ^ — > 1.64, then a = 0.05, 1-/? = 0.6406 

A/n 

Power - Size = 0.5906 

Hence Power - Size of locally optimum test is greater than Power - size of the usual test. 

Locally Optimum Unbiased Test: 

Let the random variable X follows the probability distribution P(x/ 0). Suppose it is 
desired to test Ho: 0 = 0 O against Hi : 0 ^0 q . We impose the unbiasedness restriction 
y(0) — y(Q o)< 9 7= 0 O 

and y(0) — y(0 o ) is a maximum as compared to all other regions. If such a region does not 
exist we impose the unbiasedness restriction y(0 o ) = 0. 

Let y(0) admit Taylor expansion about the point 0 = 0 O . 




Then y(0) = y(0 o ) + (0 - 0 o )t( 0 o ) + ^ 7 ^ y"(0 O )+0 



where p -> 0 as 0 -> 0. 



••• r( 0 ) - y (0 O ) = (0 - 0o)y(0 o ) + ^ 7 ^ y"( 0 o )+v 



Under the unbiasedness restriction y(0 o ) = 0, if 1 0 — 0 O | is small y(0) — y(0 o ) is 



maximised when y ,, (0o) is maximised. 



Definition 3 : A region Wo will be called a locally optimum unbiased region if 



y(0o) = L Ux/0 0 )dx = 0 



and y"(0 o ) = j L"(X/0 o )dx > J L"(X/0 o )dx 



for all other regions W satisfying (5). 



Lemma 3 : Let Wo be the region {x : L"(x/0 o )^ L(x/0 o )} 



Then Wo is locally optimum unbiased. 



Proof : Let W be any other region 



/ L"(x/ 9 0 )dx - j L”(x/9 0 )dx 



= J L"(x/9 0 )dx + J L"(x/9 0 )dx 






by subtracting the common area of W and Wo. 




= j L”(x/8 0 )dx + J L"(x/8 0 )dx, 



w 0 nw c 



since L"(x/0 o ) > L(x/0) inside Wo and outside W. 



> 0 since L(x/0) > 0. 



Example 6: 



Consider N(9, a 2 ) distribution, a 2 known 



H 0 : 9 — 9q, Hi'. 8 9q 



/ 1 Z(*i-0) 2 

L = ( — — e 2 ct 2 



L''(x/9) n 2 (x — 9) 2 n 

L{x/8 ) (j 4 a 2 



Locally optimum unbiased test rejects Ho 



n 2 (x — 9 n ) 2 n 
if ,4 - ti >1 



(j 4 a 2 



n(x - e 0 y 



> i + — 



Under H, 



n(x-0 o ) 2 



°, 



follows xfi) distribution. 



Testing Mean of a normal population when variance is unknown. 



Consider N(9, a 2 ) distribution, a 2 known. 



Fortesting Ho: 0 = 0 O against Hi: 0=0j the critical function of the optimum test is 



given by 




a. _ r 1 i/ u*/0i) ^ Kx/Oq) 
m *-0 otherwise 



On simplification we get 



f-i ^ + ^1 

0mW = 1 lf ^ 6 ~ T“ lf 

v0 otherwise 



hi > ho 



_ 0 O + 0i 

1 if x < — y^~ if M-i < bo 
0 otherwise 

Consider the case when <r 2 is unknown. 



4>m00 = 



For this case we propose a test which rejects Flo when 

£Q/0i) > 

Ux/Qq) ~ 

where L(x/9 [), (i=0,l) is the maximum of the likelihood under Hi obtained from L(x/ 9 
by replacing cr 2 by its maximum likelihood estimate 

ol = £E"=i(*/ - 6»i) 2 ; i=0,l. 

Let (p p (x) denote the critical function of the proposed test, then 

A (yi = (1 ifUx/9 0 > L(x/9 0 ) 
v tO otherwise 



On simplification we get 

lo otherwsie 

and 0 p (x) = ( 1 ^"<^ 1 ^< 0 o 

vo otherwsie 




Thus the proposed test <p p (x) is equivalent to <fi m (x) which is the optimum test that 
minimizes the sum of two error probabilities (a + /?) . Thus we see that one gets the same test 
which minimises the sum of the two error probabilities irrespective of whether a 2 is known 
or unknown. 
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